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EMPIRICAL STUDY OF INSTRUCTIONAL MATERIAL EVALUATION 
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(Presented at 47 th Annual International Convention of the Council 
for Exceptional Children, Denver, Colorado, April 8 - 12, 1969) 

The term "instructional materials" once elicited a picture of a black- 
board, a record player, and possibly an opaque projector. Today this term 
has come to mean much more. A quick trip through the exhibits area at this 
convention uncovers a wealth of instructional materials that are available 
to the classroom teacher. In fact, it could almost be called a "j ungl e” of 
instructional materials. Jungle, a highly descriptive word, brings to mind 
such thoughts as being lost, engulfed, closed in, and very threatened. 

How can we make this jungle meaningful? 

This paper is one attempt to comprehend the jungle. It is concerned 
with the evaluation of instructional materials; evaluation as a tool for 
providing today’s teacher with a means of getting into the jungle; finding 
particular materials to meet her needs; and bringing them into the classroom 
and making effective use of them. 

THE PROBLEM 

The Regional Instructional Materials Center for Handicapped Children 
and Youth at Michigan State University has co-sponsored a series of studies 
v.j.th the Office of the State Superintendent of Public Instruction in Indiana. 1 
These studies are aimed at assessing the potentialities of practitioners as 

^Funds for the Evaluation Institutes were provided by the Department of 

Special Education, Office of the Superintendent of Public Instruction, State 
of Indiana. 
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evaluators of instructional materials. 

The topic of materials evaluation has gained considerable impetus 
during the last few years. More and more projects are being undertaken 

to examine a few of the many problems associated with evaluation. Some 

* 

projects have focused on an informal approach, requesting teachers to write 
a short descriptive statement about a material they have seen or used. 

Check lists are being developed to guide these teachers in their evaluation. 

The question arises— how were the criteria for the check list developed? 

In many instances they were developed in a purely intuitive manner. A 
second question might be, is it possible to design an inclusive form or 
check list that would cover all of the necessary evaluative aspects of a 
material and its use? 

In other instances, experts have met to devise sets of criteria for 
evaluating. These criteria are usually based on more or less well defined 
learning theory and are concerned with what a particular material should 
accomplish. Extensive laboratory or field testing of a material is then 
conducted to find out if its purpose is accomplished. "Fass or fail” in 
this evaluative concept is often dependent upon how the teacher uses the 
material. If t-he teacher does not use the material to its f ull est potential 
in relation to its inherent "learning qualities," it will be less than ideally 
effective. Herein is a serious, but not well recognized, problem of evaluation: 
Do existing evaluative schemes fully take into account the wide range of 
teaching styles? 

As yet there is no basis for proposing some “right" approach that 
evaluation should take. Of more importance to the classroom teacher, 
there is no available catalog of evaluations to cover the many materials 
on the commercial market. Obviously, some sort of sound, common approach 

to evaluation needs to be developed before such a library of evaluations 
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can be produced. It is possible, however, to consider both the approach to 
evaluation and the product of evaluation simultaneously. It is this dual 
approach that has been tried in this study: the development of a library 

of material evaluations and the systematic study of the evaluation process. 

THE EVALUATION INSTITUTE 

To effectively attack both questions it was decided to hold an Evaluation 
Institute. The Institute would be built around a game structure to avoid the 
usual lectures and speeches, and provide a teacher-oriented activity with 
high motivation for the participants. 

Selected teachers in a single area of special education, the educable 
retarded, were invited to attend a three-day meeting. No prior information 
concerning the design of the Institute was provided the teachers. They 
were merely asked to participate in a state-sponsored function. Great 
care was taken at this stage. We did not want the teachers trying to 
organize their thinking prior to the Institute. Such organization is usually 
concerned with attempting to second-guess what will be discussed. In 
other words, we didn't want the teachers asking themselves, "What will 
they want me to say?" or "What should I be ready to learn?" . Instead, 
our planning called for a series of activities — games — that would allow 
them to organize their own thoughts as a part of the procedure. We were 
concerned with what they, as practitioners, thought were the important 
aspects of evaluation. 

Sub-Group Activity (Game ) 

The 16 group members were randomly assigned to four -member teams. 

Each team was given a packet of envelopes and seated around its own table 
on which were three large sacks. Their instructions were to open Envelope 




$1 and proceed as directed (See Figure l) • 

Envelope $1 instructed them to open their own Sack $1 and to discuss 
the instructional material it contained. Once it was discussed, they were 
to list ten of its strengths or weaknesses. After they finished this 
step, they went on to Envelope #2 which told them not to open Sack #2, but 
instead to list twelve questions that they thought should be asked to probe 
the strengths and weaknesses of the unknown material in the second sack, 
whatever it mi gh t be. Envelope $3 directed them to open the sack and to 
answer their own questions about the material they would find. 

Envelope #h then asked for a list of ten questions to be asked of 
another unknown material in the third sack. Envelope #5 directed them to 
open Sack #3 and answer their questions, again using pre -structured 
evaluation questions to assess a "new 11 material. 

Finally, Envelope #6 asked them to construct a listing of all the 
questions they had learned were important to probe the strengths and 
weaknesses of a material. Envelope #7 requested that they rate the items 
on a three point scale in regards to their importance. 

In setting up this activity we were concerned with finding out l) if 
different types of materials might suggest different evaluative criteria, 

2) what evaluative criteria are important to the practitioner through the 
investigation of the dynamics of systematic development, and 3 ) the effect 
of such a game-based activity as a sensitizing device, making the teacher 
cognizant of the many questions that must be asked when considering evaluation. 

The activity proved beneficial in all areas • 

To assess the effect of different types of material on the development 
of criteria, we de^sed a matrix whereby two of the groups first investigated 
a material categorized as "hardware 11 (Language Master and Audio Flashcard), 
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Figure 1 SEQUENCE OF ACTIONS FOR SUB-GROUP ACTIVITY 1 



Discuss strengths and/or weaknesses of the instructional material 
in Sack #1. List ten strengths and/or weaknesses of this material. 



List twelve questions that should be asked to probe the strengths 
and/or weaknesses of the unknown material in Sack #2. 



Open Sack #2 and answer your twelve questions. 



List ten questions that should be asked to probe the strengths 
and/or weaknesses of the unknown material in Sack #3. 



Open Sack #3 and answer your ten questions . 



List all of the questions that should be asked to probe the strengths 
and/or weaknesses of an instructional material. 



Rate your questions on a three point scale. 1— Exceptionally important 

2= Important 
3= Moderately important 



See Appendix I for exact contents of envelopes 
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and two of the groups began with a material categorized as "software" 

(workbook, reader, etc.), (see Figure 2). This aspect of the study showed 
that there were no great differences in criteria that were developed through 
exposure to hardware and software, versus exposure to software alone. 

A n four sub-groups identified evaluative criteria bhat were later 
classified according to nine general headings . Of the nine general headings 
(How is the material used?. What teacher preparation is necessary?, etc.) 
three of the sub-groups identified all nine and one identified seven. 

Criteria that was most frequently identified by the sub-groups included 
the cost of the material, whether it can be used individually or in groups, 
the type of child that it can be used with, and whether it contains student 

appeal . 

If the success of an activity can be judged by the amount of verbalization 
it has provoked, this activity was a success! The informal discussions that 
had preceded the activity turned to strong and sometimes heated debate 
concerning what items should be included or excluded in their lists of 
strengths and weaknesses 'of a particular material. It is interesting 
to note that at this stage the teachers were not yet using the word 
"evaluation." They instead were concerned with discussing particular 
materials and whether or not they could be used successfully with their 

students . 

Discussion 

The second session of the Evaluation Institute began with a discussion 
period. The participants welcomed the opportunity to share their individual 
reactions to the game activity. Copies of each sub-group* s final list of 
questions were distributed and comparisons were made. The topic of evaluation 
was introduced and the teachers were instructed to return home and think 

o 
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Figure 2 INSTRUCTIONAL MATERIALS USED IN SUB-GROUP ACTIVITY 



about possible formats that might be developed for recording and utilizing 
this information in actually evaluating an instructional material. 

Development of sin Evalu ation Form 

a 

The third session was devoted to developing such a form (see Appendix 
III A). In two stages, the group first identified those aspects of 
ev al uation that they now felt should be included in a form. Then they 
ordered the questions and decided on an appropriate format for each. 

The Evaluation Form was then duplicated smd copies made available to each 

participant . 

Using the Evaluation Form 

The fourth session of the Institute allowed the teachers to evaluate a 
large number of materials that were provided. Their evaluations were written 
on the forms they had developed. Certain of the materials were earmarked for 
evaluation by more than one evaluator. Later analysis showed that there were 
no great differences between evaluators utilizing the same format for 
evaluating a material. Of the differences that did occur, the primary one 
was due to the individual evaluator's particular teaching assignment. A 
junior high school teacher might find different value in a material than 
an elementary school teacher. As a group, however, teachers of the same 
level identified similar values. 

Modi fication and Revision of the Evaluation Form 

Finally, the fifth session allowed the teachers to modify or change their 
Evaluation Form as an outcome of their evaluating experience. The only change 
was the elimination of one minor sub -item and the modification of some of the 
modes used for recording information (using checks rather than circling an item 




An Ongoing Evaluation Group 

A recurring question throughout the Institute was the artificial environment 
in which the participants were doing the evaluating. Obviously a truer picture 
of a material could be drawn from actual classroom use. It was then decided 

that classroom evaluation would be undertaken. In this way the group could 

% 

empirically test the instrument they had developed. To best accomplish this, 

A n organizational framework was established for an ongoing evaluation group — the 
Evaluation Network of Indiana Teachers. When they returned to their classrooms, 
each member evaluated at least one new material on the Evaluation Form. 

Particular attention was paid to the utilization of the form and whether or 
not it provided sufficient latitude and specificity to make the evaluation 
meaningful. Completed evaluations were then collected and circulated to all 
members, of the group. 



FOLLOW-UP MEETINGS 

Tyjo follow-up meetings were later held with the group. The first was 
held after the form was used for a month and a half, and the second meeting was 

four months later. 

At the first follow-up meeting, the topic of discussion was the effectiveness 
of their Evaluation Form. The group was again sub-divided into four member 
teams and each participant instructed to write out one change that they thought 
should be made in the form. These changes were then collected and re-distributed 
to different individuals. Each teacher was asked to make a one-minute 
presentation to his sub-group stressing why the change noted on the piece of 
paper he now held should be incorporated in the Evaluation Form. The sub-groups 
voted on the presentations they had heard and the four "winners" were presented 
to the total group. The group acted on the changes, incorporating those that 



they felt were necessary. 
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The primary concern of "the group at this follow-up meeting was that 
the Evaluation Form was toe limiting in most of the items . Many of the 
items were of a checklist nature and it was felt that they were not inclusive 
enough. To make the checklists more inclusive, however, would yield a 
form that would he almost unmanageable. Instead, the group decided to 
eliminate most of the checklists and leave the space blank for the evaluator 
to enter the pertinent information. With the distinct possibility that some 
information would unwittingly be omitted, a thesaurus of key words was 
developed to assist the evaluator. This Evaluator* s Guide (see Appendix IV) 
consists of a page for each numbered question on the Evaluation Form. On each 
page are listings of words that might stimulate the evaluator to think of other 
aspects of the material. In use, the evaluator would first fill out the form, 
then consult the Guide for each question to see if the answer should or could 
be expanded . The Evaluator* s Guide proved to be an excellent addition. It 
was a co ns tant reminder of the Institute and the many aspects of evaluation. 

The second follow-up meeting was a discussion of the format that should 
be used for disseminating the finished evaluations. The battle was only half 
won if teachers would not take the time to read the resultant evaluations. The 
concern of the group was that the information should be related in no more 
than one page, and it should be attractive enough to invite perusal. 

A unique publication was decided upon. It was a two-part publication 
consisting of a number of printed pages and a clear acetate overlay . The 
acetate overlay, printed in red ink, contained all of the questions from the 
Evaluation Form. It did not contain, however, any of the information 
entered by the evaluator. This information — the actual evaluation — was 
printed on regular paper. Since it contained only answers and no questions, 
it could be easily scanned by a reader. The reader could glance through 



"ths printed, pages looking for evaluations of innterisls that looked interesting • 
When one is identified, the acetate overlay is placed over the printed page 
and the complete report, questions and answers, is read. 

CONCLUSION 

» 

An Evaluation Institute such as the one. described in this paper can 
provide a needed look at a practitioner-based system for evaluating instructional 
materials. Certainly, there are many other approaches and techniques that can 
and should be tried. The case reported here is a beginning. It put the focus 
on the shoulders of the classroom teacher. The classroom teacher: is the 

developer of the evaluative criteria; is the evaluator of the material; 
develops the vehicle for dissemination; and finally, reads the completed 
evaluation. All four are necessary aspects for a total approach towards 
evaluation . 

Thro ugh this study we have learned a number of interesting things. 

Given the structuring and motivation of a game-like atmosphere, teachers 
can provide a set of criteria that is meaningful to them. There seems to be 
a good deal of agreement among the teachers used in this first study concerning 
this criteria. Though this does not imply that the criteria developed by 
these teachers are those that should be used, it does suggest an initial set 
that will be further explored in future studies of this nature. 

The conclusion of this experience is that teachers do possess an under- 
standing of what are the important aspects of evaluation when concerned with 
instructional materials. The use of a game-like situation allowed the 
participants to structure their own thinking within an interesting setting. 

The result was the systematic development of a set of evaluative criteria 
that possessed meaning for the teachers . By treating it as a game, the usual 
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semantic problems associated with, a word as strong as evaluation were 
avoided. The teachers were dealing with a familiar topic. They were discussing 
the strengths and weaknesses of a material in much the same manner as they 
do over a cup of coffee in the teachers* lounge. The addition of the sealed 
envelopes provided just enough suspense to keep the group highly motivated 
in what could potentially be an exceedingly boring task. 

The study indicates that an inclusive form for evaluating different 
types of instructional materials is feasible. The approach suggested relies 
upon two facets. First, the teachers must be cognizant of the parameters 
of evaluation and the behaviors necessary for evaluating materials. Secondly, 
a vehicle must be provided for the continual re-exposure of the evaluator to 
these parameters. 

This study should not be misunderstood as a critique to the development 
and use of highly sophisticated evaluation instruments. It does suggest, 
though, that the needs of the classroom teacher do not necessarily require 
the develo pm ent of such instruments. A highly sophisticated instrument has 
value as a yardstick for material development and revision. This .study 
suggests that a teacher -developed evaluation instrument can be effectively 
utilized for the recording and dissemination of information about a material. 
Information that is being "urgently requested by classroom teachers. 

We have learned that through the use of a game-like approach it is 
possible to develop teams of evaluators. Most importantly, the use of games 
can be effectively employed to sensitize teachers in the parameters of 



evaluation . 
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APPENDIX I 



CONTENTS OF ENVELOPES USED DURING SUB-GROUP ACTIVITY 



\ erJc 



1 Envelope #1 I 



TO BE READ ALOUD TO THE GROUP: 

There are three sacks on the table in front of you. Open the sack marked #1. 

Discuss the strengths and weaknesses of the instructional material in sack #1. 

As you discuss the material, write out 10 statements. Have each statement describe 
either on strength or weakness of the material.' (It is not necessary to have 
the same number of weaknesses and strengths, but the total number should be 10.) 

When you have finished the 10 statements, return them to Envelope #1 and have it 
collected. Then go on to Envelope #2. 



1 Envelope #2 [ 



TO BE READ ALOUD TO THE GROUP: 

In the spaces below, write out 12 questions that should be asked to probe the 
strengths and weaknesses of the unknown material in safck #2. (Do NOT open sack #2) 

When you have finished the 12 questions, go on to Envelope #3 



| Envelope #3 I 

TO BE READ ALOUD TO THE GROUP: 

Open the sack marked #2. 

Discuss the strengths and weaknesses of the instructional material in sack #2. 

Answer in the spaces below the 12 questions that you wrote out before seeing the 
material. 

When you have finished answering the 12 questions, return the questions to Envelope 
#2, and the answers to Envelope #3 — then have them both collected. Then go on to 
Envelope #4. 
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Envelope #4 



TO BE READ ALOUD TO THE GROUP: 

In the spaces below, write out 10 questions that should be asked to best probe the 
strengths and weaknesses of the unknown material in sack #3. (Do NOT open sack $3) 

When you have finished the 10 questions, go on to envelope #5. 



I Envelope #5 1 



TO BE READ ALOUD TO THE GROUP: 

Open the sack marked #3. 

Discuss the strengths and weaknesses of the instructional material in sack #3. 

Answer in the spaces below the 10 questions that you wrote out before seeing the 
material. 

When you have finished answering the 10 questions, return them to Envelope #4, 
and the answers to Envelope #5 — then have them both collected. Then go on to 
Envelope #6. 



I Envelope #6 1 



TO BE READ ALOUD TO THE GROUP: 

In the spaces below write out MX of the questions that should be asked to probe 
the strengths and weaknesses of an instructional material. 

When you have finished writing out all of the questions that should be asked, 
go on to Envelope #7. 



o 
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Envelope #7 1 



TO BE READ ALOUD TO THE GROUP: 

Rate the questions that you have just written by assigning each question a number 
from 1 to 3, 



1 * Exceptionally important 

2 * Important 

3 = Moderately important 

Write the number ratings alongside the questions. 

When you have finished, return the questions to Envelope #6 and have them collected. 






1 
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APPENDIX II 



DEVELOPMENT OF EVALUATIVE CRITERIA DURING SUB-GROUP ACTIVITY 
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APPENDIX III 



EVALUATION POEMS 



A* Original form 

First revision (developed during final session) 
C. Second revision (developed at Follow-up Meeting) 



O 

ERIC- 



WWTTTT IU.4 m! I * 'J UUMJ IM'JXIJIW 
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I A. Original Form J 



EVALUATION OF AN INSTRUCTIONAL MATERIAL 
FOR THE EDUCABLE MENTALLY RETARDED 



1. Trade name of item 



2. Publisher or producer* s name and address 



3. Copyright or production date, if given 



4. Developmental information 



Not Available 



4a. Author 

4b. Where developed 

4c. Why developed 

4d. How developed 

5. Evaluation setting: 

5a. Level (circle one) Pre-primary Primary Intermediate Junior High 

Senior High 

5b. Setting (circle one) Rural Urban, Other (Specify) 

6. Description of the item: 

7. How did you use the item: 

Is this the use the manufacturer recommended? Yes No 

8. Cost: $ 

8a. Does its teaching value or effectiveness justify its cost? Yes No 

9. Physical Characteristics: 

9a. Is it adequately durable? Yes" No 

9b. Can it be reused? Yes No 

9c. Are replacement parts available? Yes No 

9d. Is it portable? Yes No 

. Is it easy to use? Yes No 




9e 
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10. Teaching Procedure: 

10a. Supervised 

10b. Individual 



Independent Activity 
Group 



11 . 



No 



Teacher Preparation: 

11a. Is a teacher manual available? Yes 

lib. If available, is it adequate? Yes 

11c. Would some special training be advisable in order to make effective 
use of it? Very necessary Helpful 



No 



lid. Are pupil progress reports provided? Yes 



No 



12. Contents: 



12a. Remedial Developmental 

12b. Factually accurate? Yes 



No 



12c. Subject matter area(s) 



13, 



Pupil reaction: 
13a . Attractive ? 



Yes 



No 



13b. Does it consistently hold the interest level over a period of time’ 
Yes No 



14. Comments: 



o 
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| B. First Revision I 



EVALUATION OF AN INSTRUCTIONAL MATERIAL 
FOR THE EDUCABLE MENTALLY RETARDED 



1. Trade name of item: 

2. Publisher or producer* s name and address: 



3. Copyright or production date, if given: 

4. Developmental information: 

4a. Author 



4b . Where developed^ 
4c . Why developed 



4d. How developed^ 



Not Available 



5. Evaluation setting (checks appropriate spaces): 

5a. Level Pre-primary Primary Intermediate 

Senior H.S. 



Junior H.S. 



5b. Setting Rural Urban Other (specify). 

Description of the item: 



7. Describe briefly how you used the item (basal, supplementary, remedial, 
developmental, etc.): 



8. Is this the use the manufacturer recommends? Yes_ 
Cost $ 



No 



8a. Does its teaching value or effectiveness justify its cost? Yes_ 



Physical characteristics: 






9a. 


Is it adequately durable? 


Yes 


No 


9b. 


Can it be reused? Yes 


No 




9c. 


Are replacement parts available? __ 


Yes 


9d. 


Is it portable? Yes _ 


No 





No 



No 



Information not available 
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9e. Is it easy to use? Yes No 

10. Teaching procedure (check fr' appropriate spaces): 

10a. Supervised Independent Activity 

10b. Individual Group 

11. Teacher preparation: 

11a. Is a teacher manual available? Yes No 

lib. If available, is it adequate? Yes No 

11c. Would some special training be advisable in order to make effective use of it? 

Very nccfissftr y Helpful Unnecessar y _ 

lid. Are pupil progress reports provided? Yes No 



12. Contents: 

12a. Subject matter area(s) (specify) : ■ 

12b. Factually accurate? Yes No 

13. Pupil reaction: 

13a. Attractive? Yes No 

13b. Does it consistently hold the interest level over a period of time? Yes_ No ; 

14. Comments (strengths, weaknesses, etc. not covered in the above): 

i 



Evaluator 
Date 




J 
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f C. w<=:gond Revision I 

EVALUATION OF AN INSTRUCTIONAL MATERIAL 
FOR THE EDUCABLE MENTALLY RETARDED 



Trade name of Item: 

Publisher or producer's name and address: 



Copyright or production date, if given: 

Developmental information: Not Available 

4a. Author 

4b. Where developed . 

4c. Why developed 



Evaluation setting: 



Contents : 

6a. Subject matter area(s): 

6b. Factually accurate? Yes No 

Description of the item: 



Describe how you used the item: 



Is this the use the manufacturer recommends? Yes No 

Cost $ 



9a. Does its teaching value or effectiveness justify its cost? Yes 



No 



u i u i. ji i mi 



10. Physical characteristics: 

10a. Is it adequately durable? Yes_ 

10b. Can it be reused? Yes No 

10c. Are replacement parts available? 

lOd. Is it portable? Yes N o 

lOe. Is it easy to use? Yes No__ 

11. Teaching procedure: 

12. Teacher preparation: 

12a. Is a teacher manual available? Yes N o 

12b. If available, is it adequate? Yes No 

12c. Would some special teacher training be advisable in order to make effective use 
of it? 

Very necessary Helpful Unnecessary 

12d. Are pupil progress reports provided? Yes No 

13. Pupil reaction: 

13a. Attractive? Yes No 

13b. Does it consistently hold the interest level over a period of time? Yes No 

14. Comments: 



No 



Yes 



No 



Information not available 



Evaluator 
Date 



ierJc 



IEG/3 







APPENDIX IV 



EVALUATOR* S GUIDE 1 



1 



The Evaluator’s Guide was designed for use with second revision of the 
Evaluation Form. 
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APPENDIX V 



RATINGS OF EVALUATIONS 1 



1 The evaluations that are rated herein were- completed on the first revision 
of the Evaluation Form (Appendix IIIB) . The primary purpose of this study 
was to provide feedback to the members of the evaluation group. 
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12345678 



Rating Sheet 

The attached Evaluation of an Instructional Material (next page) has been completed 
by a teacher of educationally handicapped children. The teacher used the material in the 
classroom for approximately one month. 

Now, assuming that you are also a classroom teacher of educationally handicapped 
children — does the evaluation "tell you anything." Using the checklist below, indicate 
your reactions to 1) the evaluation form, and 2) the information contained on it. 



I. Evaluation Form 

1. Are the categories and questions CLEAR? 

2. Should other questions be ADDED to the form? 

Which ones? 



Yes No ? (please V) \ 

( 1 ) 

( 2 ) i 



3. Should some questions be DELETED? 
Which ones? 



(3) 



II. Information on form 

4. Has the evaluator COMPLETED all questions? (4) 

5. Are the comments CLEAR? ( 5 ) 

6. Is further CLARIFICATION (illustration) needed? (6) 

7 . Is the information useful in assisting you to decide (7) 
whether you would like to use the material in your 
classroom? 

8. How could the evaluator IMPROVE the evaluation? 



: 



9 . Other comments ? 



10. Current STATUS? 
F reshman 

Sophomore 

Junior 

Senior 

Graduate 



11. Prior teaching EXPERIENCE? 

NO classroom experience of more 
than one day. 

' Student Teaching (normal) 

Student Teaching (handicapped) 

Classroom Teacher (elementary) 

Classroom Teacher (secondary) 

Classroom Teacher (handicapped) 

Other classroom experience 

(more than one day) 

1 . 

2 . 

3. 

4. 

5. 



12. How familiar are you with 
this material? 

Have NEVER seen or heard 

about 

Have seen &/or heard about 

(not used personally) 

Have used 



13. 



(name) 



(date) 
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Rating Sheet Tabulations 



I. Evaluation Form 

1. Are the categories and questions clear? 68 y es £ N o 



2. Should other questions be added to the form? 23 Y es 48 N o 2 ? 

3. Should some questions be deleted? 4 Y es ^2 N o ~J_ _? 



II. 



Information on form 

A. All questions completed? 41 Y es ^ _N o ^ 2 

5. Are the comments clear? 48 Y es ^0 N o £ ? 

6. Is further clarification needed? 38 Y es __ _33 _No 2 

7. Is the information useful? ^0 Y es N o ]_ ? 






Raters: (all are special education majors at Michigan State University) 



Freshmen 


16 


Sophomores 


3 


Juniors 


19 


Seniors 


30 


Graduates 


5 




73 



No teaching experience 44 
Prior teaching experience 29 



0 



